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Abstract. An anisotropic spin model on a triangular semiinfinite lattice with ferromag- 
netic nearest-neighbour interactions and one antiferromagnetic next-nearest-neighbour 
interaction is investigated by the cluster transfer- matrix method. A phase diagram with 
(2) antiphase, ferromagnetic, incommensurate, and disordered phase is obtained. The 
bulk uniaxial incommensurate structure modulated in the direction of the competing 
interactions is found between the (2) antiphase and the disordered phase. The incom- 
mensurate structure near the surface with free and (2) boundary condition is studied 
at different temperatures. Paramagnetic damping at the surface and enhancement of 
the incommensurate structure in the subsurface region at high temperatures and a new 
subsurface incommensurate structure modulated in two directions at low temperatures 
are found. 
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1. Introduction 

The cluster transfer-matrix method was found as a useful tool for description of 
commensurate and incommensurate structures in two dimensional and three-dimensional 
spin lattice models. It is able to describe floating incommensurate structures in two 
dimensions [1, 2, 3] as well as an infinite number of commensurate structures in three- 
dimensional models [4]. The method yields phase diagram of the model, free energy, 
correlation functions, and magnetization as a function of coordinates. As all the cal- 
culations are performed in real space, there is a possibility to study the properties of 
spatially inhomogeneous systems, e.g. a lattice with a surface, where the inhomogeneity 
is localized in one direction, and it is homogeneous in the others. 

The cluster transfer-matrix method is a generalized mean field approximation - it 
uses auxiliary effective multisite fields that are not directly related to the magnetization 
or multisite correlation functions of the model, nevertheless, the correlation functions 
can be calculated from them. In two dimensions, the spatial dependence of the fields 
in one direction is obtained by simple iterating the effective fields from one lattice row 
perpendicular to it, to the following one. It is more difficult to get the spatial dependence 
inside the row, i.e. in the direction perpendicular to the direction of the iteration. Here, 
the correlation functions of a row of spins interacting by original interactions of the 
Hamiltonian plus by the spatially dependent effective multisite fields should be found. 
For that reason the iteration in the systems with uniaxial incommensurate structure is 
always performed in the direction of the incommensurate modulation. 

The transfer matrix formalism is also used in derivation of the fermion Hamiltonian 
in the domain wall theory of commensurate-incommensurate (C-IC) transitions in 2D 
lattice models [5]. The domain walls in the incommensurate structure are described 
by world lines of fermions and therefore, the transfer matrices are defined on columns 
of sites in the direction of the incommensurate modulation, i.e. perpendicular to the 
transfer matrices used in our method. 

It is simple to study surface or subsurface properties in the systems where the 
surface is perpendicular to the direction of the iteration. In fact, this is done always when 
the bulk properties of the system are calculated, as the starting values of the effective 
fields in the iteration procedure play a role of surface boundary conditions. In this case, 
the most conspicuous properties of the subsurface region appear for paramagnetic phase 
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near the phase transition hne with the incommensurate or ferromagnetic structure. In 
the first case, the surface effects attenuate with distance from the surface in an oscillatory- 
way, in the latter case, monotonically. 

In this paper we study surface and subsurface properties of a two dimensional 
system with the surface orientated parallel to the incommensurate modulation. Now, 
the effective fields used in the iteration procedure are functions of distance from the 
surface and all of them should be stored in the computer memory. Fortunately, far 
enough from the critical point the surface effects are confined to a relatively narrow 
region, outside which the effective fields acquire constant bulk values. Thus, the shortest 
possible distance from the critical point in the parameter space is limited by computer 
memory in our calculations. 

The cluster transfer-matrix method is related to the mean field approximation of 
Jensen and Bak [6] were a nonlinear mapping of site magnetizations instead of effective 
fields is carried out. There, in distinction to our method, the physically stable solutions 
are mathematically unstable. The exact nonlinear mapping is possible on lattices with- 
out closed loops, like Cayley tree and Bethe lattice. These lattices are characterized by 
the site coordination number rather than the dimensionality. This nonlinear mapping 
technique were applied to various models including Potts [7] Ising [8] and ANNNI model 
[9]. It is difficult to relate the results for the hierarchical lattices to those for Bravais 
lattices. Nevertheless, the phase diagram of the ANNNI model on Cayley tree with 
infinite coordination number [9] bear similar features to that of the 3D ANNNI model. 

The ANNNI model defined on the square lattice and anisotropic antiferromagnetic 
(AA) model on the triangular lattice are the most simple 2D models displaying an 
uniaxial incommensurate structure. There are two competing interactions in the both 
models: ferromagnetic nn and and antiferromagnetic third-nearest neighbour interac- 
tions in the ANNNI model and antiferromagnetic nn and ferromagnetic nnn in the AA 
model on the triangular lattice. Both models are anisotropic, i.e. two of the third- 
nearest neighbour interactions and one or two of the nnn interactions are missing. Both 
models were investigated by the cluster transfer-matrix approximation and the results 
were consistent with numerous other approaches like Monte Carlo calculations, series 
expansions, cluster variation method, domain wall theory, finite-size scaling [10, 11, 12, 
13]. 

The phase diagrams of 2D models are more simple than those in the 3D case. They 
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consist of a small number of commensurate phases and a single region of a floating 
incommensurate phase. In the ANNNI model, the nn interactions are ferromagnetic 
and consequently, the rows are ordered ferromagnetically; in the AA model they have 
a commensurate structure with periodicity of three lattice constants. 

Here, we study a natural generalization of the ANNNI model to the triangular lat- 
tice. The nn interactions are ferromagnetic and one nnn interaction instead of third-next 
nearest interaction is antiferromagnetic, i.e, the signs of the interactions are opposite to 
the above described AA model. The phase diagram and all other properties are similar 
to those in the ANNNI model. Hence, it can be expected that the surface effects in the 
ANNNI model on the square lattice are closely related to the ones described bellow. 

2. Model and method 

We consider an anisotropic ferromagnetic model of Ising spins {a = ±1) on a tri- 
angular semiinfinite lattice interacting by nearest neighbour (nn) and one next-nearest- 
neighbour (nnn) interactions. All the nn interactions of the model are ferromagnetic. 
Two of the three possible nnn interactions are missing and the remaining one is anti- 
ferromagnetic. The triangular lattice with the spin interactions and the clusters used 
in further calculation are shown in Fig. 1, where j = 0, . . . , oo and i = — oo, . . . , oo. We 
shall calculate the free energy and the local magnetization by the cluster-matrix method 
developed by one of us [14]. 

The cluster-matrix method is based on a subsequent summation of the weight 
functions exp[PH{ai)] over the spin variables in the consecutive rows when calculating 
the partition function. For the computational reasons zigzag rows shown in Fig. 1 
perpendicular to the nnn interaction are chosen. The lattice surface is perpendicular to 
the rows and the expected direction of the domain walls. It is put at the column j = 0. 

Let us write the Hamiltonian of the model 




as a sum of energies of the 2x4 clusters 




We use two types of the 2x4 clusters, that are shifted by one lattice constant and 
can be transformed into each other by translation and rotation by an angle 180° in the 
plane of the lattice. They are shown in the inset of Fig. 1. 

The energy of the bulk cluster of the first type is 
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where Ji is the nearest-neighbor interaction and J2 is the next-nearest one and j = 
1, 2, . . . , 00. The terms in (1) are divided by the number of appearances of the particular 
bond in different overlapping clusters. The expression for the energy of the cluster of the 

second type denoted by 2j+i '^^^ be found by interchanging i ^ i + 1 and 2j 2j + 1 
at the right hand side of (1). The denominators in (1) are different in the expressions for 
the energies Gj^o and G\^i of the surface clusters, because the translational symmetry 
is broken here. 

The evaluation of the partition function 

can be transformed to the calculation of the numbers appearing as normalization 
factors in the iterative procedure for auxiliary functions 

Y,'^i{Si)Ti{Si,Si+,) = Ai*,+i(5,+i) (2) 

Si 

starting from an appropriate function 2, 3]. {Si denotes a row variable Si = 

{o-i,o ■ ■ ■ ,o-i,2j,o-i,2j+i,o-i,2j+2 ■ ■ ■} and Ti{Si,Si+i) = exp PYl^jZQ°° {Gi^2j + ^^,2^+1)] •) 

z = UZoK- 

Unfortunately, each of the auxiliary functions ^i{Si) acquires an infinite number 
of values and an approximation should be done to perform the summation on the left 
hand side of (2). 

Assuming an asymptotic behaviour of correlation functions already at distances 
exceeding the cluster size, we can try to factorize in the same way as the function 



Ti{Si,Si+i) = n^oexp(G'i,2j)exp(G^ 2j+i) i-e- 

oo 

^riS^) ^ n *^,2,(<2,)*U + i«2, + l) (3) 

where i denotes a set of site variables of a finite row cluster = {(Jij, . . .,ai^i^k) 

2j+i) are the cluster auxiliary functions acquiring a finite 

number of values. 

The number k characterizes the order of the approximation and was taken equal 
to 4 what is the width of the clusters in (1). (Fig. 1) 

The logarithms of the values of the cluster auxiliary function for different cluster 
configuration represent the above mentioned multisite effective fields. As the functions 
are defined on finite clusters, only short-range effective interactions are taken into ac- 
count in our approximation. 

Substituting (3) into (2), we obtain a relation between the known functions ^i,2j) 
^i,2j+i found in the preceding iteration step and the new functions ^i^i^2j, ^i+i,2j-i-i- 
The expression for ^^4-1-1^2^) ^i+i,2j+i terms of ^i,2ji ^i,2j+i *^^u found by a partial 
summation of the both sides of (2). This problem is one-dimensional and the partial 
summation can be done exactly — again by the technique of auxiliary functions as shown 
in detail in previous papers [1, 2, 3, 14]. In contrast with the previous calculations on 
infinite lattices, the equation (2) has no translational symmetry in the row direction 
due to the presence of the surface and the equation should be solved for all \E'i+i^2j, 
^i+i 2j+i' j ~ O7 • • • 7 practice, the cluster auxiliary functions converge to their 

bulk values fast if we are far enough from the continuous incommensurate-commensurate 
(IC-C) phase transition. We confined ourselves to the distances from the IC-C phase 
transition line where the number of the cluster aiixiliary functions taken into account 
did not exceed j = 400. 

In the paramagnetic and ferromagnetic phase ^i,2j, ^i,2j+iJ depend on i, 

in the (2) antiphase consisting of zig-zag rows with alternating magnetization, ^i,2j, 
^i,2j+i periodic functions of i with period of two. In the incommensurate phase, 
their period is a continuous function of the interaction constants. The functions \E'i,2j, 
2j+i are j independent in the bulk, i.e. the row structure is ferromagnetic or para- 
magnetic in all phases. Nevertheless, they are strongly spatially modulated near the 
surface what leads even to the areas of reversed magnetization. 
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From the knowledge of the auxihary functions ^ and it is possible to find the 
site magnetizations. We have 

Si j 

where are the functions that are calculated by the same iteration procedure as 

in (2) but in the opposite direction. 

3. Results and discussion 

The calculations have shown that the anisotropy model with competing nn and nnn 
interactions on a triangular lattice can be found in one of the four phases: disordered 
paramagnetic, commensurate (2) antiphase, ferromagnetic, and the incommensurate 
one lying between them. 

The phase diagram of the model, shown in Fig. 2, is similar to the phase diagram 
of the 2D ANNNI model on the square lattice [2, 10, 11]. Near the multiphase point 
J1/J2 = 1 the disordered phase should persist to T = in the form of an extremely 
narrow strip. Unfortunately, by our method it is not possible to verify this fact at 
very low temperatures and the direct phase transition between the ferromagnetic and 
the incommensurate phase cannot be excluded. On the other hand, we found no signs 
confirming the opposite case. For J1/J2 — > the incommensurate phase seems to be 
stable down to the point T = 0. The IC-disorder phase transition line seemingly tends 
to a Lifshitz point at the ferro-disorder phase transition line but at the close vicinity 
of it, it turns abruptly down and apparently meets it at T = 0. It is seen that a less 
careful numerical treatment of the problem could lead to an erroneous confirmation of 
the Lifshitz point in 2D ANNNI model. 

When we put J2 = 0, the exactly solvable ferromagnetic Ising model on the trian- 
gular lattice with the critical temperature Tc = 3.732 ... is restored. Our method yields 
Tc = 3.64. We believe that the comparison of this two values suggests the accuracy of 
the whole phase diagram shown in Fig. 2. 

The interaction constants and temperature in all further presented results are lo- 
calized in the areas denoted by two short bars in the incommensurate region of the 
phase diagram near the phase transition lines with the disordered paramagnetic phase 
and (2) antiphase, respectively. At the higher temperature the bulk magnetization is 
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of a sinusoidal shape. At the lower temperatures the structure consists of strip-like (2) 
antiphase domains. Their width is growing to infinity with temperature approaching 
the IC-C phase transition line. The bulk structures can be seen in the depth more then 
400 columns from the surface in the following figures. 

We consider two different boundary conditions at the surface: the free boundary 
condition (FBC) and the (2) antiphase boundary condition (ABC). In our approach 
the boundary condition is given by the starting values "ifi^o of the auxiliary function. 
For FBC all values of the auxiliary function on the surface are taken equal to unity. 
The ABC boundary conditions can be simulated by the values of the cluster auxiliary 
function deep in the bulk of the (2) structure at low temperature. Actually, they have 
been taken as an output of calculation at J1/J2 = 0.5, T/J2 = 0.1 for j = 600. 

The site magnetizations at every second zig-zag row and at first 480 subsurface 
columns for T/J2 = 1.47,1.252,1.247,1.241 are shown in Fig. 3a-d. All these figures 
are calculated for the FBC. In Fig. 4., the magnetization along the rows of sites with 
maximum absolute value of magnetization as a function of distance from the surface is 
shown. 

As expected, the amplitude of the sinusoidal magnetization at the surface is di- 
minished by the absence of interactions for FBC at the temperature T/J2 = 1.47, close 
to the paramagnetic structure. This suppression is replaced by an enhancement of the 
incommensurate waves of magnetization in the narrow subsurface region (Fig. 3a) . The 
presence of the surface affects, approximately, only first 60 columns at this temperature. 
Similar increase of the magnetization profile near the surface was found for semi-infinite 
ferromagnetic Ising model [15]. 

The situation is different for temperatures near the IC-C phase transition where 
wide one-dimensional domains of (2) structure bounded by domain walls perpendicular 
to the nnn J2 interaction J2 occur in the bulk. Two neighbouring domains differ by 
a phase shift of tt (Fig. 3b-3d). Near the surface, the strip- like bulk domains become 
modulated, as well, and incommensurate domains are formed in the direction perpen- 
dicular of the nnn interaction. By approaching the IC-C phase transition line (lowering 
the temperature) the region of the biaxial incommensurate structure becomes wider 
and its depth changes linearly with temperature, as shown in Fig. 5. Extrapolating the 
linear plot to the temperature of the phase transition Tjc-c = 1-1876, the width of the 
biaxially modulated structure at the critical point is found approximately equal to 1300 
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columns. 

Fig. 6 and 7 shows that the influence of the boundary condition is smaU. The 
change from FBC to ABC affects only first few subsurface columns. The phase of the 
(2) structure is fixed at the surface, but it does not infiuence the phase in the bulk that 
changes quite freely at the domain walls. The structure perpendicular to the surface is 
unaffected, as well. 

The cluster auxiliary functions ^i,2j, ^i,2i+i ^^e direct output of the iteration 
procedure and in the bulk behave similarly to the magnetization shown in the previous 
figures. In the low-temperature incommensurate structure, they form one-dimensional 
strip-like domains possessing the symmetry of (2) phase. Near the surface the domains 
bend in the direction opposite to the direction of the iteration. 

This situation is shown in Fig. 8, where one of the 64 values of the cluster auxiliary 
function '^i,2j at subsurface lattice sites is plotted. The direction of the iteration is 
from the left to the right, i.e. the domains a bended backwards. It looks like there 
is a friction between the auxiliary-function structures and the surface when the space 
evolution of the auxiliary function is calculated by the iteration procedure. 

The domains are bended but near the surface they are again straight. The bending 
angle between the direction of the bulk and surface domain is increasing when approach- 
ing the critical line as shown in Fig 5. At the critical temperature, the angle tends to 
45°. 

The magnetization is calculated from eq. 4 which involves two auxiliary function 
which are iterated in opposite directions and therefore their surface parts are bended 
in the opposite sense. The surface incommensurate structure is in fact their interfer- 
ence pattern and the resulting modulation of the magnetization has a two-dimensional 
character. 

As the the bending angle of the auxiliary-function domains is between 0° and 45° 
the 2D magnetization domains are oblong at higher temperatures and become square- 
like near the phase transition line. On the other hand, if the linear extrapolation is 
applicable up to the critical line, the width of the bulk domains becomes infinite while 
the width of the surface region remains finite. Thus, the subsurface structure should in 
fact disappear at the phase transition. 

The width of subsurface structure was measured as a distance from surface to the 
point of the maximum curvature of the bended domain wall. 
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In conclusion, influence of the surface on the incommensurate structure of an 
anisotropic Ising model on a triangular lattice was investigated by the cluster transfer- 
matrix method. The uniaxial incommensurate structure in a finite region near the sur- 
face changes its character and becomes biaxial. The width of the biaxially modulated 
structure seems to be finite at critical temperature. Formation of the biaxial struc- 
ture can be interpreted as an interference pattern of two auxiliary-function wave-like 
structures. 

From a more physical point of view, it can be seen as a result of a misfit between 
the bulk structure with longer periodicity than that of the surface structure due to the 
absence of a part of interactions at the surface that is equivalent to an effective increase 
of temperature. 
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FIGURE CAPTIONS 



Fig. 1. Anisotropic model on triangular half lattice with two competing interactions. 
Each spin interacts with 6 nn spins by Ji interaction (thin lines) and 2 nnn spins by J2 
interaction (thick lines). The two types 2x4 clusters used in the calculation are in the 
inset. Our zig-zag row encompasses two ordinary rows of the triangular lattice. 

Fig. 2. Phase diagram of the model. Two short bars (at J1/J2 = 0.5, T/J2 = 
1.241, 1.47) show the parameter regions of the calculations presented in Figs. 3-8. 

Fig. 3a. Site magnetizations rrii^j = {(Tij) at the first 480 subsurface columns (j = 
1, . . . , 480) for T/J2 = 1.47, J1/J2 = 0.5 and FBC. 

Fig. 3b. Site magnetizations niij at the first 480 subsurface columns for T/J2 = 
1.252, J1/J2 = 0.5 and FBC. 

Fig. 3c. Site magnetizations rriij at the first 480 subsurface columns for T/J2 = 
1.247, J1/J2 = 0.5 and FBC. 

Fig. 3d. Site magnetizations rriij at the first 480 subsurface columns for T/J2 = 
1.241, J1/J2 = 0.5 and FBC. 

Fig. 4. Site magnetizations rriij in the direction perpendicular to the surface as a 
function of the column number j at T/J2 = 1.241 (the thickest curve), 1.247, 1.252, 
1.47 (the thinnest curve) and J1/J2 = 0.5 for FBC. The curves follow one of ridges of 
the structures in Figs. 3a-d. 

Fig. 5. Width of the surface aff'ected region (stars) and angle a between of the bulk 
auxiliary-function domain wall and the domain wall near the surface (triangles). 

Fig. 6. Site magnetizations rriij at the first 480 subsurface columns for T/J2 = 
1.241, J1/J2 = 0.5 and ABC. 

Fig. 7. Site magnetizations niij in the direction perpendicular to the surface as a 
function of the column number j at T/J2 — 1.241 (the thickest curve), 1.247, 1.252, 

12 



1.47 (the thinnest curve) and J1/J2 = 0.5 for ABC. The curves foUow one of the ridges 
of the structure in Fig. 6. 

Fig. 8. Cluster auxihary function '^ij at the first 480 subsurface columns for T/J2 = 
1.247, J1/J2 = 0.5 and FBC. Direction of iteration is from the left to the right. 
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